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© Circuit ibr producing brightness signal from output signal of solid state image pIcK-up apparatus 
using spatia) pbtei shift 



@ A color television camera TncUiding red. graen 
and blue solid state image sensors each having a 
nomI?er of llgtrt receiving ©laments anrangad in ma- 
trix for receivtng said red color image to derive red. 
green and blue color signals, the light receiving 
elements of tie green solid state image sensor be- 
ing shifted in the horizontal scanning drrection with 
respect to those of (he red and blue solid state 
image sensors over a distance which is equal to a 
half of a pitch of the arrangement of the light receiv- 
ing elements in the horizontal ^c^ning directionp 
red. green and blue correlate double sampling cir- 
cuits for sampling the red, green and blue color 
signals to derive sampled red, green and blue color 
signals, respectively, a delay circuit for delaying the 
sampled green color signal by a delay time which 
con-esponds to a half of a pitch of the arrangement 
of the light receiving elements viewed in the horizon- 
tal scanning direction to derive a delayed green 
color signal, red, green and blue low pass filters lor 
removing higher frequency components of the red. 
green and blue color signals.red, Qv^ft and blue 
color signal processing circuits for processing the 
rod. green and blue color signals, respectively* a first 
matrbc circuit for mixing the red, green and blue 
color Signals supplied from the red, green and blue 
color signal processing circuits, respectively with 
each other at a ratio of 0.30:0.5d:0.l 1 to derive a first 
brightness signal, a second matrix circuit for mbdng 



the red color Signal generated by the red correlate 
double sampling circuit the delayed green color 
signal genemted by the delay circuit and the blue 
color signal generated by the blue correlate double 
sampling circuit at a ratio of 0^5:0.5:0,25 to dedve a 
second brightness signal, a band pass filter for ex- 
tracting a higher frequency component from the sec- 
ond brightness signal, and an adding amplifier for 
adding the higher frequency component to the first 
brighmess signal to derive a final brightness signaf- 
The high frequency component is derived by mixing 
the color signals before processing the low pass 
filters and signal processing circuits at the ideal 
ratio, and thus the effect of the spatial pbcel shift can 
be attained optimally and the resolution of the repro- 
duced image can be increased. 
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The present invention relates to & circuit for 
producing a brightness signal from an output signal 
of a solW state im^ge pick-up apparatus, m which 
^ least two solid state image sensor each having a 
number of light receiving elements arranged in 
matrix are arranged in such a manner that light 
receiving elements of one solid state image sensor 
are shifted spatially in a main-scanning direction 
over a distance substantially equal to a half of a 
pitch of successive light receiving elements with 
respect to light receiving elements of other solid 
5tate image sensor. 

In a solid state in\age sensor, each light recerv- 
ing elements constituting pixels are ewstent in- 
dependently from each other and a sample signal 
is obtained spatially, "merefore, the maximum spa- 
tial frequency which cari be reproduced by a single 
solid state image sensor is limited to V2 in accor- 
dance with the Nyquist sampling theory, wherein U 
is a horizontal clock firequency. When a frequency 
range higher ftan the maximum spatial frequency 
fc/2 is obtained^ a higher frequency component is 
folded back toward a lower frequency range, which 
results in a spurious signal. In order to obtain a 
higher resolution without producing the spurious 
signal component, in a color television camera us- 
ing three solid slate image sensors, light receiving 
elements of a green image sensor are spatially 
shifted in the main-scanning direction, 1^. horizon- 
tal scanning direction with respect to light rec^ng 
elements of red and blue sofid slate image sensors 
over a distance which is substantially equal to a 
pitch of arrangement of tiie Wght receiving elements 
viewed in the horizontal scanning direction. Such a 
method is usuany called a spatial pixel shift. 

Fig. lA is a schematic view showing a known 
color television camera using the above explained 
spatial pixel shift As illustrated in Rg. lA, an 
image of an object is fonned by an objective lens 1 
and is divided by a three-color splitting opticas 
system 2 into three primary color images, i.e. ined, 
green and blue images. These color Images are 
made IncidBnt upon solid state image sensors 3R, 
3G and SB, respectively. As depicted in Fig. IB, 
pixels of ti\s solid state image sensor 3G receiving 
the green image are spatialiy shifted in the horizon- 
tal direction vwtii respect to pixels of the solid state 
image sensors 30 and 3B for receiving the red and 
blue Images, respectively over a distance which is 
equal to a half of a pitch P of the pixels viewed in 
the horizontal direction. By using the spatial pixel 
shift method, the spatial sampling is carried out 
such that successive pixels of the red and blue 
image sensors 3R and 3B are situated between 
successive pixels of the green image sensor 3Q, 
vmen the brightness signal is formed by adding 
the green, red and blue signals with each other, the 
number of pixels is apparently increased, end tiius 



tiie resolution is improved, while the spurious com- 
ponent folded back into the lower frequency range 
can be reduced. 

Fig. 2 is a block diagram showing a known 
5 circuit for producing a brightness signals from the 
red, green and blue color signal generated by the 
red, green and blue image sensors 3R. 3G and 3B, 
respectively of the color television camera urfng 
the spatial pixel shift The red, green and blue color 
iQ signals are supplied to correlation double sampling 
Circuits 4n, 4G and 4B, respectively, and tiien the 
green color $ignal is delayed by a delay circuit 5 
having a delay time which is equal to a half of the 
sampling period, so that tiie phase of the green 
7S color signal is made coincident with tine phase of 
the red and blue color signals, it should be noted 
that said sampling period oon'osponds the pitch of 
light receivtog elements of the image sensors 3R, . 
3G and 3B viewed in the horizontal ecanning direc- 
io tion. Then, tiie red. green end Wue color signals 
having tiie coina'ded phase are supplied to low 
pass filters 6R, 6G and 6B which cut off frequency 
components higher ti^n the sampling frequency to 
remove sampling clock noise. Further, the red, 
2$ green and blue color signals are supplied to image 
signal processing circuits 7R, 76 and 7B, respec- 
tively which perform the amplitude compresston 
and 7 con'ection. Finally, the red. green and blue 
color signals are supplied to a matrix circuit 8 and 
^ are mixed with each other a? a predetermined ratio 
to derive tiie brightness signal. In accordance witii 
the standards of NTSC, tiie red, green and blue 
color signals are added with each other ae a ratio of 
0.3:0^9:0.11. 

3$ The derived brightness signal is amplified by an 
amplifier 9 and then is supplied to an output termi* 
nal of the television camera. Since the spatial pixel 
shift is utilized, the spurious signal folded back 
toward tiie tower frequency range which might de- 

40 teriorate the quality of the reproduced color image 
is reduced and the resolution of the brightness 
signal is apparently improved. 

In the known color t^vision camera, the phase 
of the gfBen color signal is delayed with respect to 

45 tiie red and blue color signals by passing the green 
color signal tiirough the delay circuit 5 having the 
delay time corresponding to the 1/2P. However, the 
color signals are processed by the low pass filters 
eR, 6G, 6S and image signal pn^cessing circuits 

50 7R. 7Q, 7B which also cause time delay for the 
color signals. Therefore, the phases of the red, 
green and blue color signals are not made identical 
with watch other precisely and the resolution of the 
brightness signal is decreased. 

5S Further, in order to attain tiie improvement in 
tiie resolution by utilizing tiie spatial pixel shift, the 
circuits provided between the color image sensors 
3R, 3G, 3B and the matrix circuit B must have 
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frequency charact^stics which can process sig- 
nals having frequencies sufficientiy higher than the 
dock f r<3quency of the solid state image sensors- 

When an object having a pattern having a 
repetitive pitch substantially equal to the pixel pitch 
as shown in Rg. 3A is picked-up by the known 
television earners and the solid state image sen- 
sors are read out by the cloclc illustrated In Fig. 3B, 
the green color s'lgna! is delayed with respect to 
the red and blue color signals by the time cor^ 
responding to a half of th© pixel pitch. Fig. 3C 
shows the green color signal before being pro- 
cessed by the low pasd filter 6G and Fig. 3D 
illustrates the red or blue color signal R or B before 
being tansmitted througti the tow pass filter 6R or 
6B. When these Ideal color senate are mbced in 
the matrix circuit 8, there is derived an Ideal bright- 
ness signai Y depicted in Fig. 35. However, in 
practice, the low pass filters 6FU 6G and OB have 
the f^requency characteristic in which higher fre- 
quency component is suppressed in order to re- 
move the dock noise. Further the image signal 
processing cirtrults 7R. 7G and 78 could hardly 
derive the ideal color signals shown in Rgs. 3C 
and 3D. Therefore, the higher frequency compo- 
nents of the actual green, red and blue color sig- 
nals er, R* and B' obtained after being transmitted 
through the low pass ftlters 3G, 3R and 3B and 
image signal proce9$big circuits 7G. 7R and 7B are 
suppressed as Illustrated in Figs. 3F and 3G. TTiis 
results in that the frequency response of the actual 
brightness signal V is reduced to a large extent as 
shown In Fig. 3H. 

In the spatial ^el shift, it Is ideal to mix cobr 
signals at a ratio of 1:1- However, in the known 
color television camera using the spatial pixel shift, 
the green and red color signals are added with 
each other at a ratio of 2:1 and the green and blue 
color signals are mixed with each other at a ratio of 
6:1. Therefore, the effect of the spatial pixel shift 
oould not be achieved fully and the spurious signal 
could not be sufTicientty removed and thus the 
resolution of the reproduced image is reduced. 

The present "irwention has for its object to 
proved a novel and useful circuit for deriving the 
brightness signal from the output signals of the 
color image sensors of the color television camera 
using the spafial p^el shifty in which the effect of 
the spatial pixel shift can be attained optimally and 
the resolution and frequency response of the 
brightness signal can be improved. 

According to the Inventiori, a circuit for produc- 
ing a brightness signal from an output signal of a 
solid state image pick-up apparatus. In which at 
least two solid state image sensors each having a 
number of Rght receiving elements arranged in 
nnatrrx are arranged in such a manner that light 
receiving elements of one solid state image sensor 



are shifted spatially in a main-scanning direction 
over a distance substantially equal to a haK of a 
pitch of successive light receiving elements with 
respect to light receiving elements of the other 

5 solid Stat© image sensor, comprises: 

delaying means for delaying an output signal 
generated by said one solid state image sensor by 
a delay time corresponding to a half of a spatial 
sampling period so that a phase of the output 

TO signal of sadd one solid stale image sensor is made 
coindded with a phase of an output signal of said 
other solid state image sensor; 

first filtering means for for cutting off higher 
frequency components contained in an output sig- 

15 nal of said filtering means and in the output signal 
of said other solid state image sensor; 

^gnal processing means for processing output 
signals of said first filtering means; 

first matrix means fbr adding output signals of 

20 said signal processing means with each other at a 
predetermined ratk) to produce a first brightness 
signal; 

second matrix means fbr adding the output 
signal of said delaying means and the output signal 
25 of said other solid state knage sensor with each 
other at a ratio of 1:1 to derive a second brightness 
signal; 

second filtering means for extracting a high 
frequency component from said second brightness 

$0 signal; and 

adding means for adding said high frequency 
component derived by said second filtering means 
with said first brightness signal. 

In the brightness signal producing circuit ac- 

3S cording to the invention, the second brightness 
signal is fbrmed by mixing the output signals which 
are not processed by the first filtering means and 
signal processing means which miglit . reduce the 
resolution and frequency re^onse at the ratio of 

49 1:1 at which the effect oT the spatial pixel shift can 
be attained optirnaily. Then, the frequency compo- 
nent of the second brightness signal higher than a 
frequency range predetermined by a television 
standard system is extracted from the second 

45 brightness signal and the thus extracted higher 
frequency component is added to the first bright- 
ness signai- Therefore, when an object having a 
high ^atial frequency is picked-up. it is possible to 
derive the brightness signal having the very high 

so resolution and frequency response, while the effect 
of tfie spatial pbcel shift can be achieved optimally. 

For a better understanding of the invention, 
reference is taken to the accompanying drawings, 
in which: 

$$ Rgs. 1 A, 1 B and 1 C are schematic views show- 
ing the construction of the known color televi- 
sion camera using the spatial pixel shift; 
Pig. 2 is a block diagram illustrating a known 
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circuit for producing the brightness sfgnal in the 
color teJevisloo camera using the spatial pixel 

shift: 

Rgs. 3A to 3H are signal waveforms for explain- 
ing the oporatan of tho known brightness signal 
. producing circuit shown in Fig. 2; and 
Fig. 4 is a block diagram depicting an embodi- 
ment of the brightness signal producing circuit 
according to the invention. 
Rg. 4 Is a block diagram showing an embodi- 
ment of the circuit for producing the brightness 
signaJ from output signals generated by a color 
television carf\era using the spatial pixel shift An 
image of an object is formed by an objective lens 
11 and is divided into three pnmary color images 
by means of a color spTitting optical system 12. 
The red» green and blue color images are then 
made incident upon red, green and blue solid state 
image sensors 13R» 13G and 13B, respectively to 
generate red, green and blue color signals. These 
color signals are then supplied to correlate double 
sampling circuits 14R, 14G and 14B, respectively 
and are sampled therein in accordance with a 
predetermined sampling clock. The green color 
signal is then delayed by a delay circuit 15 by a 
delay time which corresponds to a half of the pitch 
of the anrangement of light receiving elements 
viewed in the horizontal scanning direction. In this 
manner, the phase of the green color signal is 
made coincided with the phase of the red and blue 
color signals. 

The red, green and blue color signals are then 
supplied to low pass filters lea 166 and 16B. 
lespectively to remove the sampling ck>ck noise. 
Then Output color signals from the low pass filters 
16F1 163 and i6B are further processed by image 
signal processng circuits 17R, 176 and 17B, re- 
spectively to effect the various functions such as 
the 7 correction and amplitude compression. Out- 
put signals from the image signal processing cir^ 
cuits 17R, 176 and 17B are supplied to variable 
delay circuits 18R. 18G and 18B, respectively to 
connect differences in the phases off the color sig- 
nals. Then, output s'^nals of the varfable delay 
circuits 18R. 18Q and 18B are supplied to a first 
matrix circuit 19 and are mixed with each other at a 
ratio which has been determined by the television 
standard to derive a first brightness signal Yi. In 
rnSC system, the red, green and blue color sig- 
nals are mixed with each other at a ratio of 
0.3!0.59!0-11. 

The construction so far explained is same 
same that of the known brightness signal producing 
circuit. According to the invention* the red and blue 
color signals derived from the correlate double 
sampling circuits 14R and 14B and the green color 
signal derived from the delay circuit 15 are sup- 
plied to a second matrix circuit 20 and are mixed 



with each other at a ratio of 1:i to pnDduce a 
second brightness signal Yg. That is to say, the 
r«d, green and blue color signals ft, G and B are 
mixed at the following ratio: 

5 

R;G:6 =0.25:0.5.^.25. 

In this connection, it should bo noted that ac- 
cording to the invention, a ratio of a sum of the 

10 color signals generated by the image sensors in 
' which the spatial pixet shift is taken place and a 
sum of color signals of the image sensors in which 
the spatiaJ pixel shift is not effected becomes in. 
Therefore, in the present embodiment, the green 

IS color signal is equal to a sum of the red and blue 
color signals. 

The second brightness signal derived ffom the 
second matrix circuit 20 is then supplied to a band 
pass fitter 2i for extracting a higher frequency 

go component In the second brightness signal, said 
higher frequency component being higher than the 
predetermined maximum frequency of the first 
brightness signal which has been derived by mix- 
ing the color signals at the predetermined ratio. 

25 The higher frequency component thus extracted is 
then supplied to a delay circuit 23 giving a given 
delay time tor conning a possible difference in 
the delay time between the first brightness signal 
Yi and the second brightness signal Ye. Finally, the 

so first brightness signal Yi generated from the first 
matrbc circuit 19 and second brightness signal Ya 
derived from the delay cin:uft 22 are supplied to an 
adding amplifier 23 and are added with each other 
to derive a finsJ brightness signal Y. 

55 in the present invention, the higher frequency 
cojmponent contained In the final brightness signal 
Y is obtained by mixing the color srijnals at the 
ratio which is different from the television standard. 
However, in the television standard, there is no 

40 condition for the higher frequency component so 
that there would occur any problem. The difference 
in the delay times of the color signals in the low 
pass filters IBR 16G, 16B and image signal pro- 
cessing oircufts 17a 17G, 17B can be corrected 

^ by adjusting the variable delay circuits ifiR, 180. 
18B. Therefore, when there is not produced any 
delay time difference in these circuits, the variable 
delay circuits may be dispensed with. The delay 
time in the delay circuit 22 may be detennined by 

$0 considering the delay times in the low pass filters. 
Image signal processing circuits, variable delay cir- 
cuits, second matrix circuit and b»and pass filter. By 
providing the variable delay circuits 18R, 16G. 18B 
and delay circuit 22, it is possible to produce the 

$$ brightness signal Y having the very high resolution 
and frequency response without being affected by 
the small difference in the phase, so that the effect 
of the spatial pixel shift can be attained optimdly- 
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The present invention is not Hmited to the 
embodiment just explained above, but many modi- 
fications and alternations may be conc€aved by 
those skilled in the art within the scope of the 
invention. For instance, when the phase difference s 
induced by the image signal processing circuits 
178, 17G and 17B Is very small and these circuits 
can process the higher frequency components, the 
higher frequency component derived from the de- 
lay circuit 22 may be panallelly supplied to the 10 
image signal processing circuits 17fi, 17G and 17B 
as shown by broken lines in Fig. 4. Further In the 
above embodiment, the second brightness signal 
Y2 IS formed by mixing all the color signals, but 
according 10 the Invention, the second brightness 75 
signal may be produced by mixing the green and 
red color signals or the green and blue color sig- 
nals- In this case, the green color signal and the 
red or blue color signals are mixed with each other 
at a ratk) of G:R or Q 0^:0.5. 20 

As explained above in detail, in the brightness 
signal producing dnxiit according to the invention, 
the color signals which have not been transmitted 
through the tow pass filters and signal processing 
circuits are supplied to the second matrix circuit 2S 
and the color signals generated from the image 
sensors in which the spatial pixel shift is perfbrmed 
are m^xed with each other at *e ratio of 1:i to 
derive the second brightness signal, and then the 
higher frequency component Is extracted from the 90 
second brightness signal and the thue extracted 
higher frequency component Is added to the first 
brightness signal which has been derived by mbo- 
ing the color signals at the ratio which is predeter- 
mined by the television standard. Therefore, the ss 
second brightness signal is n<« suffer from the 
difference in the delay time in the low pass filters 
and signal processing circuits, and thus the reduc- 
tion of the resolution due to the difference in the 
delay time can be removed. Further, the second 40 
brightness signal is not affected by the frequency 
band limftailon and deterioration in the frequency 
characteristic and therefore the deterioration in the 
resolution and frequency response can be avoided. 
Moreover, the second brightness signal is formed 4$ 
by mixing the color signals at the ratio of 1:1 in 
regardless of the television standard, the effect of 
the spatial pixel shift can be always attained opti- 
mally. 

so 

Claims 

1. A Circuit for producing a brightness signal from 
output color signals of a solid state image pick- 
up apparatus,, in which at least two solid state ss 
image sensors each having a number of light 
receiving elements anranged in matrix are ar- 
ranged in such a manner that light receiving 
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elements of one solid state image sensor are 
shifted spatially in a main-scanning direction 
Qver a distance substantially equal to a half of 
a pitch of successive light receiving elements 
with respect to light receiving elements of the 
other solid state image sensor, comprising: 

delaying means for d^aying an output sig- 
nal generated by said one solid state image 
sensor by a delay time corresponding to a half 
of a spatial sampling period so that a phase of 
the output signal of said one solid state image 
sensor is made coincided with a phase of an 
output signal of said other solid state image 
sensor; 

first filtering means for for cutting off high- 
er frequency components contained in an out- 
put signal of said filtering means and in the 
output signal of said other solid state image 
sensor; 

signal processing means for processing 
output signals of said first filtering means; 

first matrix means for adding output sig- 
nals of said signal processing means with each 
other at a predetermined ratio to produce a 
first brightness signal; 

second matrix means for adding the output 
signal of said delaying means and the output 
signal of said other solid state Image sensor 
with each other at a ratio of 1:1 Id derive ft 
second brightness signal; 

second filtering means for extracfing a 
high frequency component from said second 
brightness signal; and 

adding means for adding said high fre- 
quency component derived by said second 
filtering means with said first brightness signal 

a. • A circuit according to claim 1, wherein said 
adding means comprises an adding amplifier 
for adding said higher frequency component to 
said first brightness signal supplied by saW 
first matrix meane. 

3. A circuit according to claim 1, wherein said 
adding means comprises a connecb'ng means 
for Supplying said higher frequency component 
to said signal processing means. 

4. A drcuit according to claim i or 2. frjrther 
comprising variable delay means arranged be- 
tween said signal processing means and said 
first matrix means for adjusting the phase of 
the color signals. 

6. A circuit according to claim 1 or 2, further 
comprising a delay circuit for delaying said 
higher frequency component 
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6. A color television camera comprising: 

an objective lens for fomiing an imag© of 
an object to be picked-up; 

a color separating optical system for sepa- 
rating said image of the object into red, grcerv 
and blue color images; 

a red solid state image sensor having a 
number of light receiving elements arranged in 
matrix for rec^vins said red color image to 
derive a red color signaJ; 

a blue solid state image sensor having a 
number of light receiving elements arranged in 
matrix for receiving said blue oolor image to 
derive a bUie color signal; 

a gr^en eoUd state Image sensor having a 
number of light receiving elements arranged "m 
matrix for receiving said green color image to 
derive a green color signal, said light receiving 
elements being shifted in the horizontal scan- 
ning direction with respect to those of said red 
and blue solid state image sensors over a 
distance which Is equal to a half of a pitch of 
the an^gement of tfie ifght receiving elements 
in the horizontal scanning direction; 

a red conrelate double sampling circuit for 
sampling said red color signal to derive a 
sampled red color signal; 

a green correlate double sampling circuit 
for sampling said green color signal to derive a 
sampled green color signal; 

a blue con-elate double sampling circuit for 
sampling said blue color signaJ to derive a 
sampled blue color signal; 

a first delay circuit for delaying the sam- 
pled green oolor signal generated by said 
green correlate double sampling circuit by a 
delay time which corresponds to a half of a 
pitch of arte arrangement of the light receJving 
elements viewed in the horizonial scanning di- 
rection to derive a delayed green color signal: 

a red tow pass filter for removing a higher 
frequency component of said sampled red col- 
or signal generated by said fed correlate dou" 
ble sampling dncuit to derive a filtered red 
color signal: 

a blue low pass filter for removing a higher 
frequency component of said sampled blue 
oolor signal generated by said blue correlate 
double sampling circuit to derive a filtered blue 
color signal; 

a green low pass filter for removing a 
higher frequency component of said delayed 
green color signal generated by said first delay 
drcuft to derive a filtered gn^en color signal; 

a red color s^nal processing circuit for 
processing said filtered red color signal to de- 
rive a processed red color signal; 

a green color signal processing circuit for 



processing said filtered green color signal to 
derive a processed green color signal; 

a blue color signal processing circuit for 
processing said filtered blue color signal to 

5 derive a pnacessed blue color signal; 

a first matrix circuit for mixing said filtered 
red, green and blue color signals supplied 
frorn said red, green and blue color signal 
processing circuits, respectively with each oth- 

70 er at a first ratio to derive a first brightness 

signal: ^ 
a second matrix circuit for mixmg said red 

sampled color signal generated by said red 

correlate double sampling circuit, the delayed 

7$ green color signal generated by said first delay 
circuity and said blue sampled color signal 
generated by said blue con'elate double sam- 
pling circuit at a ratio of 0,25:0^:0.25 to derive 
a second brightness signal; 

20 a t>and pass filter for extracting a higher 

frequency component of said second bright- 
ness signal; and 

an adding amplifier for adding said higher 
frequency component to said first brightness 

2$ signal to derive a final brightness signal. 



7* A color television camera according to claim 6, 
ftjrther comprising 

a red variable delay circuit for adjusting a 
phase of said pnscessed red color signal; 

a green variable delay circuit for adjusting 
a phase of said processed green color signan 

a red variable delay Circuit for adjusting a 
phase of said processed blue color signal. 

a. A color television camera according to claim 7. 
further comprising a second delay circurt for 
adjusting a phase of said higher frequency 
component of the second brightness signaL 

9. A color television camera according to daim 8. 
wherein said first matrix drcuit is constnjcted 
to mix the processed red» gneen and blue color 
signals with each other at a ratio of 
0.30:0^:0.11. 
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